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ABSTRACT 

We show that if one uses the invariant form of the Boltzmann-Shannon con- 
tinuous entropy, it is possible to obtain the generalized Pareto-Tsallis density 
function, using an appropriate "prior" measure m g (x) and a "Boltzman con- 
straint" which formally is equivalent to the Tsallis q-average constraint on the 
random variable X. We derive the Tsallis prior function and study its scaling 
asymptotic behavior. When the entropic index q tends to 1, m g (x) tends to 1 
for all values of x as this should be. 

PACS: 0590+m, 02.50.-r, 05.45.Df 



1 Introduction 

Most of the probability distributions used in natural, biological, social and eco- 
nomic sciences can be formally derived by maximizing the entropy with adequate 
constraints (maxS principle) p^. 

According to the maxS principle, given some partial information about a 
random variable i.e. the knowledge of related macroscopic measurable quantities 
(macroscopic observables) , one should choose for it the probability distribution 
that is consistent with that information but has otherwise a maximum uncer- 
tainty. In usual thermodynamics, the temperature is a macroscopic observable 
and the distribution functions are exponentials. 

Quite generally, one maximizes the Shannon-Boltzmann (S-B) entropy: 

,6 

Sb = — p(x)\np(x)dx (1) 



1 



subject to the conditions 

b rb 

p(x)dx = 1, / gi(x)p(x)dx =< g t (x) >, i = 1, 2, .. (2) 

«/ a 

Both limits aand & may be finite or infinite. The functions gt(x) whose expecta- 
tion value have been usually considered £Q as constraints to build probability 
distributions are of the type 

x, x 2 ,x n , (x— < x >) 2 , | x |, | x— < x >|, lnx, (lnx) 2 , ln(l ± x), exp(— x).... (3) 

The maximum entropy probability density function (mepdf) depends on the 
choice of the limits of integration a and b and the functions gi (x) whose expec- 
tation values are prescribed. 

One constructs the Lagrangian 

r b 

p(x) \n{p(x)dx (4) 

r-b r-b 

-A ( / p(x)dx - 1)-^ \j{ / gi(x)p(x)dx- < g^x) > 

J a ; J a 

and differentiating with respect to /(x), one finds easily : 

p(x) = Cexp[- ^ ^i9i( x )) ( 5 ) 

i 

The factor C is a normalization constant and the Lagrange parameters Xi are 
determined by using the constraints (eqs.2,3).When this cannot be achieved sim- 
ply, the parameters are defined by the constraints. Most distributions derived 
from the constraints given in eq.3 posses finite second moments and hence be- 
long to the domain of attraction of the normal distributions. Those which belong 
to the domain of attraction of the Levy (stable) distribution i.e. the Cauchy 
and the Pareto distributions are obtained with a characteristic Levy tail param- 
eter [i > 1 indicating that only a finite expectation value (first moment) can be 
defined. In particular using the simplest constraint 

xp{x)dx =< x > (6) 

o 

one obtains the density 

p(x) = (1/ < x >) exp(-x/ < x >) (7) 

which is the basis of Boltzmann thcrmostatistics if we identify x with the energy 
E and define the temperature as T = k < E > where k is the Boltzmann 
constant. 
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2 Shortcomings of the S max principle 



This traditional utilization of maxS principle has two main shortcomings. 

The first one is that it cannot provides distributions belonging to the basin of 
attraction of Levy distributions when the Levy heavy tail index (i < 1. i.e. distributions 
corresponding to the statistial properties of non-averaging systems. Applied to 
thermostatistics this means that it cannot be applied to nonextensive systems. 

The second, pointed out repeatedly for decades by Jaynes[2][H], is that the 
continuous form of the Boltzman-Shannon entropy is not invariant and should 
be written more correctly as 

p(x) In ^p-dx (8) 
m(x) 

in order to have a distribution invariant under parameter change. The function 
m(x) is called the measure function. It is proportional to the limiting density 
of discrete points. So it is the entropy, relative to some measure, which has to 
be maximized. 

Under a change of variable the function p(x) and m(x) transform in the same 
way. If we maximize the entropy 

p(x) In ^prdx (9) 
m(x) 

with the constraint 

J g(x)p(x)dx = 1 (10) 
The Lagrange multiplier method yields for p{x) the solution 

p(x) = Cm{x)e- X9{x) (11) 

The meaning of the measure function has been discussed at large by Jaynes 
[2] Ej- If there is no constraint maximizing the entropy yields p(x) — Cm(x) 
where C is a normalizing constant. It is the distribution representing "complete 
ignorance" 

3 Tsallis entropy 

The most popular method to circumvent the first difficulty is based on a gen- 
eralization of the Boltzmann entropy known as the Tsallis entropy0][Sj. This 
method has been used with some success to deal with thermostatistic proper- 
ties of slightly chaotic and nonergodic systems presenting memory effects and 
long-range interactions. 
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The Tsallis entropy is appropriate for system weakly chaotic power law mix- 
ing when the Liapounov exponent is tending to zero and the relevant phase 
space instead of being translational invariant (as in the Gibbs-Boltzmann case) 
is scale invariant (fractal or more generally multifractal) . We start from the 
Tsallis nonextensive entropy 



St = - p q q (x)]n qPq (x)dx (12) 
Jo 

subject to the conditions 

J />oo 

p q (x)dx = 1, / g q ,i (x)p q (x)dx =< g q ,i(x) > q , i = 1,2, . . (13) 
Jo 

Pq(X) — Jq(X) = — —/ ^> 

f a Pq(x)dx J a p q /q {x)dx 

where the functions p q (x)(x) are the so-called "escort" probability . Gen- 
eralizing what has been done with the standard S-B entropy (eqs.1-4), one can 
write the constraints using the generalized ^-exponential and g-logarithm func- 
tions (^-constraints) . 



ln 9 x — — exp 9 (x) = [1 + (1 — q)x] l ~<> with ln g (exp ? (a;)) = x 

(15) 

construct the corresponding Lagrangian and differentiating with respect to 
p q {x) one finds |8] 

Pg(x) = C q exp g [- ^ \,i9q,i( X )] ( 16 ) 

i 

p q {x) = C q p q (x)« (17) 

The factors C q are normalization constants and the Lagrange parameters \ q ^ 
are determined by using the g-constraints. If one chooses the simplest constraint 
with g q .i(x) = x defining the so- called q-average 



^q( x ) = / x)p q (x){x)dx =< X > q (18) 

Jo 

we get the generalized Pareto density supported on the positive half-line and 
defined in the range 1 < q < 2. 

p q (x) = (1/(2 -q)<x > q )[l + — ^— (19) 
p q ( x ) = (l/ < x>q )[l + ^— \ — ]-i^r (20) 

£ Q v, X '* > q 
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and the corresponding Pareto-Tsallis distribution supported on the positive half- 
line. 

p q w = i - [i + -f- 1 —^—r^ (2i) 

2 — q < x > q 

Defining the tail index fj, = ^5y, the distribution P q (x) has an asymptotic 
algebraic behavior 

p q (x- > oo)- > (l/fi) x-t*- 1 (22) 

P q (x- > oo)- > (l/fi) x' 11 (23) 

The n-th moments E[x™] of the random variable of the random variable X dis- 
tributed according to eq.() exists only if n<[i (hence for 1 < q < ^y). Therefore 
P q (x) belongs to the domain of attraction of the completely assymmetric stable 
Levy distribution. These properties and their consequences are widely discussed 
in the literature. 00 

4 Determination of the prior for nonextensive 
entropy 

We can now come to the second shortcoming. The meaning of the measure 
function has been discussed at large by Jaynes[2][H]- In the continuous case 
even before we can apply maximum entropy principle, we must deal with the 
problem of complete ignorance (for instance all microstates are equiprobable 
in Boltzmann-Gibbs thermodynamic). For "fractal" systems ignorance means 
scaling invariance. It is therefore legitimate to ask what is the scale invariant 
measure function or "prior" which should be used to obtain the Generalized 
Pareto-Tsallis density function if we would use the correct invariant form 

S I = - ^ Pq (x)ln^\dx (24) 

J0 m q( X ) 

and use the constraint 

< g(x) >= Jg{x)p q (x)dx (25) 

Starting from the identity 

Sj = - [ Pq (x) In ^\dx = S T = [ ( Pq (x)) q ln qP (x)dx (26) 
J m{x) J H 

we derive the following relations: 

\np q (x) - lnm(i) = {pgix))^ 1 h\ q p q (x) (27) 
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St — Sb+ < lnm(s) > 
or defining the " Kullback-Leibler divergence" KL(p(x), g(x)) 

KL(p q (x),m(x)) = S(p g , m) - S B (28) 

the quantity 

S(p q ,m) = - < lnm(x) > (29) 

being known as "cross-entropy". The cross entropy is always greater than or 
equal to the entropy, this shows that the Kullback-Leibler (KL) divergence is 
always nonnegative and furthermore KL(p(x),p(x)) is zero. We obtain easily 

ElM_ eMij){x)) <i-Hn q p q {x)] (30) 
m q (x) 

We use the definition of ln 9 (eq.15), and obtain 

m q (x) = p g (x)exp(m g (— £-r) (31) 
Pq\ x ) 

If we choose for p q (x) the generalized Pareto-Tsallis function with reduced vari- 
able ( < x > q = 1) 

Pq (x) = (l + ^-x)-^ (32) 
z q 

We obtain easily the following results: 

1 x 
lnqi Mx) ] = (2-q) + ( q -l)x (33) 

1 X 

m q {x) = exp (-- x) exp(— — — — ) (34) 

2-3 (2-q) + {q-l)x 

If we define the q— Laplace transform in he sense of Lenzi et al. : 

/•oc 

C q [f(t)](s) = F q (s) = I f(t)[exp q (-t)] s dt (35) 

we have 



o 



/,/,(./•),/.,- = ./•,(!. = / f(t)[e X p q (-t)}dt with/(t)= 1 + { t q _ 1)t (36) 



>o Jo 
In term of the Levy tail index 



M = 7 (37) 

9-1 
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we can write 



m q (x) = (1 + -.t)-^ 1 ) cxp( (M + 1)a: ) (38) 

jjj fJj ~\~ X 

This function obeys the following asymptotic behaviors 

m g (x- > oo)- > cxp(l + ^-x^^ 1 (39) 



m q (x- >0) = l-(p + l)(x/fi) 2 + ... (40) 

The prior function m q (x) has the scaling invariant asymptotic form of a com- 
pletely asymmetric Levy stable distribution. In Fig.l and Fig. 2 we represent 
the function for two value of q (1.2 and 1.8) coresponding to values of the tail 
index \i (4 and 0.25) and for the physical range 1 < q < 2. 

5 Maximization of the invariant entropy 

If we maximize the entropy 

Sj = [ Pq {x)\n^-dx (41) 
J m(x) 

with the constraints 

/>oo />oo 

/ p q (x)dx = 1 / g(x)p q (x)dx = 1 (42) 
Jo Jo 

The Lagrange multiplier method yields for p(x) the solution 

Pq (x) = Cm q (x)e- Xg W (43) 

We will recover the Tsallis function 

Pq (x) = (l + ^-x)-^ (44) 
z q 

if 

(2- g)+ Vl)* = (1/(2 " q)) l + ( q -iy(2-q)x = ^ ^ 

i.e. 

A = 1 , (< g{x) >= 1) and g(x) = (1/(2 - g)) — — — (46) 
In that case the constraint (equation ) reads 

3 (x)p 9 (x)dx = (1/(2 - <?)) y x(l + < L-l x )-^Tdx = 1 (47) 
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which is the Tsallis q-average constraint on the variable x since 

p q (x) = (1/(2 -q))(l + lzl x )-& (48) 
z q 

is the Tsallis escort probability (eq.19). Therefore the use of the correct non 
invariant form 

Si = - r p q {x)\n^L dx (49) 

with the "prior" 



m q (x) = exp ? (-- — -x) exp(— — - ; - — — ) (50) 



2-/ )eXP( (2- g ) + (5-l)^ 

and the constraint 



J 9{x)p q {x)dx = 1 (51) 

with 

pW = (V(2- 9 )) t — W 

yields the generalized Pareto density 

p q (x) = (l + ^x)-^ (53) 

and the "Boltzmann" constraints (eq.) is equivalent to the Tsallis constraints 
< x > q = 1. 

6 Conclusions 

We have shown that maximizing the invariant continuous Boltzmann-Shannon 
entropy with appropriate prior measure and constraint provides the Generalized 
Pareto Tsallis distribution which is the basis of the nonextensive thermostatistic. 
This point of view opens paths for deriving superstatistics directly from the 
"universal" invariant Boltzmann-Shannon entropy. 
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